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Abstract 

We discuss the question of recurrence for persistent, or Newtonian, random 
walks in Z^, i.e., random walks whose transition probabilities depend both 
on the walker's position and incoming direction. We use results by Toth 
and Schmidt-Conze to prove recurrence for a large class of such processes, 
including all "invertible" walks in elliptic random environments. Furthermore, 
rewriting our Newtonian walks as ordinary random walks in a suitable graph, 
we gain a better idea of the geometric features of the problem, and obtain 
further examples of recurrence. 

Mathematics Subject Classification: 60C50, 37B20, 60K37, 82C41. 

1 Introduction 

A persistent random walk (PRW) in a lattice is a second order Markov chain on 
that lattice. In other words, if {X„}„gN is a realization of the chain (a walk), the 
transition probabilities at time n depend not only on the position X„, but also on 
the incoming direction X„ — X„_i (in a sense, the walker's "velocity"). For this 
reason, one can term this type of random walk 'Newtonian'. 

In this note we treat exclusively PRWs in 7? with nearest-neighbor transitions, 
or jumps, but we consider both space-homogeneous and inhomogeneous transition 
probababilities (in jargon, environments) . In the latter framework, we pay particular 
attention to random environments (REs). 

Our goal is to give general ideas and specific techniques to prove recurrence for 
these random walks. In particular, using results by Schmidt and Conze OIHl and by 
Toth jTj, we establish recurrence for a large class or PRWRE. Also, we present an ad 
hoc construction that maps our nearest-neighbor Newtonian random walks in 7? into 
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first order random walks in a certain graph T. For some examples, this isomorphism 
easily entails recurrence, or lack thereof. We hope that this construction can be 
fertile ground for further study. 

We lay down the notation: A persistent random walk in is a Markov chain 
P'^ on X A, where A := {±ei, ±62} (ei, 62 are the generators of 7?) and 00, the 
environment, is an element of 

g ■= Mf = {u; = {cuj,ez2 | u;, e Ma} (1.1) 

Here Ma denotes the set of all 4 x 4 stochastic matrices indexed by the elements of 
A. If C, '■= {xo,do) G X A is an initial condition, the Markov chain is uniquely 
determined by the laws 

P^{{Xo,Do) = {xo,do)} = l; (1.2) 

Pr{(^n+l,/^n+l) = {X',d') I (X„,D„) = {X,d)} = I '^^^^'^'^'^ ottwlt."^' ^^'^^ 

The environment and the walk are called homogeneous if uj^ = constant. 

If a probability 11 is defined on S — more precisely on S, the infinite-product 
cr-algebra naturally induced by definition p.lj) — and is a random element of 
(£^,E,n), then we have a measured family (an ensemble) {P'^}i^^£ of PRWs. In 
this case we speak of 'persistent random walk in a random environment'. As it 
is physically reasonable, we will always assume 11 to be invariant for the natural 
action of Z^ on S. In fact, 11 is generally taken ergodic for that action; e.g., 11 can 
be the product of Z^ copies of a probability measure on Ma (case of i.i.d. transition 
probabilities). 

Persistent random walks were introduced by Szasz and Toth in the 1980s jSzTt ITj 
as stochastic models for systems of a particle moving chaotically in a i/- dimensional 
space under the influence of a certain force, for example the gradient of random 
potential. Specializing to u = 2 and observing Fig. [H call L^x^ the side of the unit 
square centered in x G Z^ that has d as its inner normal. Indicating by g,p G M^, 
respectively, the position and the momentum of the particle, consider the cross 
section 

Af= [j Afi'^^ := [j {{q,p) eR^ xR^ \ qe L^f, p ■ d > O} . (1.4) 

xez'^ x<^'i? 

If T : A/" — > Af is the first-return map generated by the dynamics of the particle, 
then, in general, 

iq,p)eN'^'^^ =^ r(g,j9) G 7Vj(^p for some / G A (1.5) 

(excluding of course those orbits that intersect -^i+j tangentially or in a corner). If 
one assumes that, relative to some distribution of initial conditions, the dynamics 
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Figure 1: Construction of the cross-section N . Lx is the bottom side 
of the unit square centered in x E Z^. 

inside each unit square is so chaotic that the particle's outgoing side appears to 
depend only on the incoming side and not on the exact incoming coordinates, then 
one is approximately justified in replacing a true orbit of the map with a 

realization -D„)} of the random walk. 

We call a PRW isotropic if, Vx G Z^, rf' G A, 

J2^x{d,d') = l- (1.6) 

that is, the are doubly stochastic matrices. In this case, the process can be 
inverted by means of another PRW. Furthermore, the family {-P^^jgez^xA is time- 
invariant in the following sense: For all positive integers k, 

P^iiX,, D,) = (xi, . . . , (X„, D„) = (x„, dn)} = (1.7) 

n) \-^n: dn)}- 

n 

This type of situation simulates, for instance, a Hamiltonian system defined by a 
random potential Kj(q') that is zero on every L^x^ (cf. the random Lorentz gases of 
IjLej). In this system, if one takes into account the conservation of energy (redefining 
A^i"^^ in (|1.4p with the additional condition |pp = constant), one sees that the Liou- 
ville measure induces on Af an invariant measure n that assigns the same weight to 
every , whence the term 'isotropic'. Clearly ii{Af) = oo. 
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A PRW is said to be elliptic if there is an e > such that, \/x, d, d', 

Lj,{d,d')>e. (1.8) 

A PRWRE is eUiptic if ()1.8|) holds with an e independent of lo e S. 

The question of recurrence for ordinary (i.e., first order) RWRE is settled in 
dimension one but open and intensively pursued for u >2 Zj. The seminal work of 
Schmidt [S| and Conze [HI has shown that, in dimension two, recurrence is implied 
by the Central Limit Theorem (plus ergodicity). This result has been established 
only in particular cases, the most famous of which are perhaps Lawler's 'balanced' 
walks |Laj (where the transition probabilities in the directions v and —v are the 
same). We also mention the improvement by Komorowski and OUa |KOj for certain 
'two-fold stochastic' walks. It should be noted that all these results require the 
ellipticity condition, the analog of (jl.8p for ordinary RWRE. 

This is the plan of the paper: In Section |21 we lay out some basic definitions 
together with a simple recurrence result for homogeneous environments. In Section 
OJwe prove that all isotropic elliptic PRWRE (and more) are recurrent. In Section |3] 
we make a step further by introducing F, the dual graph for nearest-neighbor PRWs 
in Z^. PRWs in become first order RWs in P. We see that P is not outrageously 
complicated and, in some cases, recurrence is easy to establish. Finally, in the 
Appendix, we present a recurrence result for the Manhattan lattice which will be 
used (and generalized) throughout Section HI 

Acknowledgments. I am greatly indebted to Eric Carlen, to whom I owe the dual 
graph idea (Section^. I also wish to thank Massimo Campanino, Nadine Guillotin, 
Firas Rassoul-Agha, Domokos Szasz, and Balint Toth. This research was partially 
supported by NSF Grant DMS-0405439. 

2 Preliminary definitions and homogeneous walks 

In our Newtonian RW it is necessary to distinguish between absolute directions in 
Z^ and relative directions to the motion of the random walker. We call the former 
East, North, West, and South, and use the symbols 

E:=ei, N:=e2, W := -ei, S := -63. (2.1) 

For the latter, we use the terms Right, Forward, Left, and Backward. These are 
functions of a given direction G A; precisely, if rf-*- G A is such that {d, d-^) has the 
same orientation as (61,62), they are defined as 

n{d) := -d^, F{d) := d, L{d) := d^, B{d) := -d. (2.2) 

In ascending order of strength, the following are the properties that we are interested 
in, for our random walks: 
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Definition 2.1 The PRW in the environment u G S is said to have asymptotic 
velocity v eR"^ if, G x A, 



In case f 7^ 0, one says that the walk is ballistic. 

Definition 2.2 The PRW in cu is diffusive if there exist two constants C2 > Ci > 
such that, G x A, 



where is the expectation w.r.t. P^ . If, in addition, Xnj \fri tends in distribution to 
a non- degenerate centered Gaussian, then we say that the walk satisfies the Central 
Limit Theorem ( CLT) with zero asymptotic velocity. 



By the Markov property, this clearly implies that, almost surely, (X„, Dn) = {Xq, Dq) 
for infinitely many n. On the other hand, the walk is transient if, for every finite 
i? C Z^ X A, there exists almost surely an m > such that Dn) ^ B \fn > m. 

Remark 2.4 In the case of random environment {S, S, 11), all these definitions are 
meant for Il-a.e. u E S. 

In the homogeneous case, that is, when Ux = constant, these properties are 
rather easily investigated with the methods of finite Markov chains. Nevertheless, 
for the sake of completeness, we present here a rather general result for that case. 

Theorem 2.5 Assume that a homogeneous PRW, (i.e., = cuq Vx G Z^j is defined 
by an irreducible aperiodic stochastic matrix ujq G Ma- A necessary and sufficient 
condition for the walk to satisfy the CLT with zero asymptotic velocity, and be re- 
current, is that 




P|^- almost surely. 



C,n<E^{\Xn\^) <C2n, 



Definition 2.3 The PRW in 00 is recurrent if, G Z^ x A 



P^{{Xn, Dn)=i= (Xo, Do), for some n > 0} = 1. 



1 - u;o(E, E) - c<;o(W, E) _ 1 - c<;o(E, W) - cJo(W, W) 
u;o(N,E)+cuo(S,E) ~ u;o(N, W) + cuo(S, W) 
wo(E,N) + a;o(W,N) _ a;o(E, S) + cuo(W, S) 



(2.3) 



1 - a;o(N, N) - a;o(S, N) 1 - a;o(N, S) - uo,{S, S) ' 



// the walk is isotropic, as per definition / li.6|) . the above condition is clearly verified. 
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Proof. As the environment is homogeneous, fix without loss of generahty ^ 
{xo,do) = (0,ei). The statistical properties of 



rt-l 



X„ = 5^D, (2.4) 

k=0 

are simply inferred from the statistical properties of the finite Markov chain {Dn}, 
governed by the stochastic matrix o^o- It is well known that a finite, irreducible, 
aperiodic Markov chain satisfies the CLT for the number of visits in each state. 
More precisely, if tt = (vr^, n^, , tt^) is the (unique) stationary vector of uq, 
determined by 

J2 '^'^ Md, d') = tt'^' Vrf' e A, (2.5) 

and Cn = (C^, C^, , Cn) is the so-called counting vector, given by 

C^=#{0<fc<n-1 \D, = d}; (2.6) 



then 



Cn — mx 



(2.7) 

'n 

converges in distribution, as n +oo, to a multivariate centered Gaussian |R,Sj . 
By linearity, then, (X„ — nV) / \fn, with 

y := Tr^E + TT^N + Tr^W + Tr^S, (2.8) 

also converges to a centered Gaussian. Therefore, the RW will satisfy the CLT as 
per Definition 12.21 if and only if ^ = 0, that is, if and only if vr^ = vr^ and vr'^ = vr^. 

Let us prove the sufficiency of condition ()2.3|1 . Denote by A G [0, +oo] the value of 
the four equal expressions in ()2.H|1 . For each such A, there is a unique pair pi,p2 > 
such that 

Vi^V2 = \ - = A. (2.9) 
2 pi 

Is it easy to check that ()2.3|1 is equivalent to p := (pi,P2,Pi,P2) verifying ()2.5|1 . and 
thus being equal to tt. This last sentence also shows the necessity of fl2.H|l if \^ = 0, 
that is, if TT is of the form (pi,p2,Pi,P2)- 

As for the recurrence, let us reinterpret our Markov chain as the dynamical 
system (A^, a, P), where a is the left shift on A^ and P is the Markov probability 
induced on A^ by the stochastic matrix ujq and the stochastic vector vr. It is well 
known |RSj that if ujq is irreducible and aperiodic (a.k.a. ergodic) then this system 
is ergodic. Furthermore, by the above, the cocycle fl2.4|l satisfies the CLT with zero 
mean. Hence, by Conze's theorem on the recurrence of dynamical cocycles [0], 
Xn = 0, P-a.s., for infinitely many n. For at least one (and thus infinitely many) 
such n, it must also be that Dn = Ci (by the Markov property and the fact that, 
if {Xn,Dn) = {0,d), there is a positive probability that {X^^Dk) = (0,ei) for some 
k > n). Q.E.D. 
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3 Toth environments 

A large class of PRWRE can be proven recurrent by combining the Sclimidt-Conze 
theorem with a previous result by Toth jTj. The latter extends Kipnis and Varad- 
han's proof of the invariant principle jKVj (namely, convergence to Brownian motion 
in the proper scaling) to isotropic elliptic PRWRE, and others. 

To properly state the theorem, we need a couple of definitions: For y and 

{TyUj)^:= U^ + y (3.1) 

represents the natural action of 7? on £. Also, let W denote the transition matrix 
of the standard random walk, namely, 

W{d,d') = ^ W,d'eA. (3.2) 

Theorem 3.1 Assume that {r^} is an ergodic group of automorphisms on {S, S, 11). 
Suppose also that, U-a.s., u is isotropic and, 

VxgZ^ \\uJx-W\\ <1-€, (3.3) 

for some e > (\\ ■ \\ is the standard operator norm for 4x4 matrices). Then the 
associated PRWRE verifies the CLT and is recurrent. 

Proof. First of all, due to the translation-invariance of 11, we can assume that 
Xq = 0. Secondly, we incorporate the randomness of the environment into a unique 
Markov chain that describes all walks in all environments. This Markov chain is 
defined on the state space A x £^ and its realizations are denoted by {{Dn, ^n)}- It 
is uniquely determined by the laws 

P{(Do, fio) G A X 5} = ^ n(5); (3.4) 
P{(/^n-M,f^„+i) = id',uj') I (Z)„,a„) = id^u)} = I otherwise'"^' ^^"^^ 

In dniH), |v4| is the cardinality of A C A, and B G E. In the theory of RWRE, this 
process is sometimes called 'the point of view of the particle'. 

As in the proof of Theorem 12. 5| we exploit the associated dynamical system 

{[AxSf,a,F), (3.6) 

where a is the left shift on [A x S]^. Using ()1.6|) and the translation-invariance of 
n in fl3.5|) . we see that (| ■ | ® n)/4 (where | ■ | is the counting measure on A) is a 
stationary measure on A x Since this is the same as the initial distribution chosen 
in (13. 4j) . we conclude that P is a stationary measure for the entire process, which is 
equivalent to saying that (|3.6|) is a measure-preserving (non-invertible) dynamical 
system. 
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Remark 3.2 The non-invertibility is merely our choice. Since ()1.6|) imphes that the 
process can be defined for negative times too, using the transposed environment, one 
could have introduced an invertible dynamics on [Ax S]'^, also preserving P. In this 
case, Schmidt's result on recurrent cocycles [S] would apply as well as Conze's (O]- 

In jT] it is proved that this dynamical system is ergodic and, more importantly, 
that the associated RW satisfies the invariance principle. This means that, defining 
-Rn(O) := and, for j = 1, 2, . . . , n. 



Rn( —] '■— ~i=^y^Dk, 



(3.7) 



and extending the definition to all t G [0, 1] by means of linear interpolation, the 
distribution of the random path : [0, 1] — > converges weakly to that of a 
Brownian motion. That is, if / is a continuous function of the space C([0, 1]; M^) of 
all such paths (endowed with the usual weak* topology), then 



fiRn)d¥~ / fdWs ^ 0, (3.8) 

[Ax£f JC([0,1];R2) 

as n +00. Here Ws is the 2D Wiener measure with zero drift and variance S (by 
isotropy S must be a positive multiple of the identity). 

It is then a trivial corollary that X„, which is a cocycle of ()3.6|) by means of 
fl2.4|) . satisfies the CLT. This and the ergodicity of ()3.6|) imply, via CJ, that Xn = 
for infinitely many n, P-a.s. 

We need to prove that also (X„, Dn) = (0, -Do), ioT infinitely many n, P-a.s. For 
a.e. {{Dn,^n)} G [A X S]^ it makes sense to denote by k the smallest n > such 
that Xn = 0, and set 

a{{Dn,nn)} :=(T'{(Dn,nn)}. (3.9) 

The map a preserves P because a does. Therefore, by the Poincare Theorem applied 
to ([A X S]^,a,F), a point that starts in {Dq = (Iq} will return there at infinitely 
many times k with Xk = 0, yielding the sought assertion. 

Which, as it is evident, is equivalent to the saying that, for every ^ = (0, (Iq) and 
n-a.e. u e S, {{Xn,Dn)} is recurrent w.r.t. P^. Q.E.D. 

The next lemma shows that the strongest requirement in condition ()3.3|) is not 
the strictness of the bound, but its uniformity. 

Lemma 3.3 IfQ,Q^ G Ma then \\Q — W\\ < 1. The inequality is strict if and only 
if Q^Q is irreducible and aperiodic. 



Remark 3.4 The irreducibility and aperiodicity of Q^Q are implied by a number 
of conditions given directly on Q: 
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1. All the entries of Q are positive (which, for want of a better term, we may 
call 'local ellipticity'). As a matter of fact, it is enough that no column of Q 
contains more than 1 zero. This implies that the entries of Q^Q are positive. 

2. Q is irreducible, aperiodic and normal. In this case, the entries of {Q^QY = 
{Q'^YQ'^ are positive, for k large enough. 

3. Q is irreducible, aperiodic, and its diagonal entries are positive. In fact, in 
this case, Q can be rewritten as Q = pi + Q, where p > 0, 1 is the identity, 
and all the entries of Q are non-negative. Therefore, the entries of 

{Q'^Qf = (pi + Q^)Q ■ • ■ (pi + = P^Q" + • ■ • (s.io) 

are positive, for large k (the remainder terms all have non-negative entries). 

It would be a mistake, however, to conjecture that for all doubly stochastic, irre- 
ducible, aperiodic Q, \\Q — W\\ < 1. An exception, for example, is 



1 
I i 
10 

olio 



(3.11) 



Proof of Lemma 13. 3L We start by noting that W is an orthogonal projection 
in C^. The hypothesis that Q is doubly stochastic is equivalent to 

QW = WQ = W. (3.12) 

This implies that the eigenspaces of W, namely, E := span{(l, 1, 1, 1)} and E-^, 
are invariant w.r.t. Q and . The action of Q — W, relative to the decomposition 
= E Q) E-^, is easy to calculate, using that Q is stochastic: 

Q-W = {Q-1)\e(B Q\e^ = Q\e^- (3.13) 

Now 

llQUx||' = ll(Q'^Q)Ux||<l (3.14) 

by the Perron-Frobenius Theorem applied to the self-adjoint stochastic matrix Q^Q. 
By the same theorem, Q^Q is irreducible and aperiodic if and only if its eigenvalues 
for the subspace E-^ have all modulus < 1, i.e., if and only if ||(Q^Q)|£;i|| < 1. 
Q.E.D. 

As an illustration of the strength and limitations of Theorem 13. H let us consider 
a few examples. Clearly, the theorem applies to all isotropic and elliptic random 
environments. 



10 



Marco Lend 



Moving on, for all x G Z^, produce i.i.d. random vectors {CxXx^Cx) with (x + 
C + C = 1- Assume nothing about the probability law for the stochastic vector, 
except that its components must be larger than a certain e > 0. Then set 

(Vci e A) ux{d, F) = Cx, Ux{d, L) = C, R) = C, B) = 0. 

(3.15) 

where we have abbreviated notation ()2.2|) as F = F{d), L = h{d), etc. This con- 
struction defines a RE {S, E, 11) that is evidently isotropic and verifies the hypotheses 
of Theorem 13.11 — condition ()3.3p holds via Remark |3.41 pt. 1 (or 3). 

The same holds if the roles of F and B are swapped in ()3.15|) . 

On the other hand, if, Il-a.s., uJx{d, ±d) = Vx, d, then Theorem EH] does not ap- 
ply because uj'^Ux is reducible and llciJs — || = 1. We may call any such environment 
'Left-Right environment' (more about this in Section |3)). 

Even conceding on this last example and similar ones, the real shortcomings of 
Theorem 13.11 are two — or maybe three. First, the uniformity of assumption ()3.3p . 
which seems too much of an absolute requirement for a probabilistic problem (on the 
other hand, in the realm of ordinary RWs in 2D, this is mirrored by the ellipticity 
condition, which is an hypothesis of all general recurrence results known to this day 
[Z]). Second, and more important. Theorem 13.11 does not cover non-isotropic REs. 
Third, and least relevant, it implies nothing about a given, specific, inhomogeneous 
environment. 

In the next section we improve the situation somewhat. 

4 The dual graph 

Suppose that we want to visualize a persistent RW in as a first order RW in 
X A. We quickly realize that the most immediate mental image of Z^ x A, that 

is, four stacked copies of Z^, is not really the best to work with because, due to the 

costraints p.3p . from a given (x, ci) G Z^ x A the walker can only transit to the four 

other sites (x -|- d', d'). Once we draw, for every x, d, d', an oriented edge from (x, d) 

to (x -|- d', d'), we are left with a rather labyrinthic picture. 

A better choice, it seems, is to consider F, the dual of the graph G whose vertices 

are the points of Z^ and whose oriented edges are the pairs of nearest-neighbor 

relations. See Fig. |21for the construction of F. 

If we consider the picture of F given in Fig. El we can make the following obser- 
vations: 

1. The diagonal edges of F (those that are followed when the particle goes Left 
or Right) form two connected subgraphs Mi and M2, each isomorphic to the 
Manhattan lattice M (see Appendix). 
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Figure 2: Construction of T: The nearest-neighbor edges of are 
turned into the vertices of T, and the relations of possible consecutiveness 
between those edges are turned into the (oriented) edges of T. Only one 
elementary building block of T is shown here; see Fig.Olfor a wider view. 



2. Calling B the set of all short horizontal or vertical edges (corresponding to 
the particle going Backward) and F the set of all long horizontal or vertical 
edges (particle going Forward), we see that each edge in B U F connects Mi 
to M2 or viceversa. That is, BU F = L_|_ U L_ , where L_|_ is the set of all edges 
leading from Mi to M2 and L_ is the set of all edges leading from M2 to Mi. 

3. Although r is invariant for the action of Z^, the partition Mi U M2 U U L_ 
of its edges is only invariant for the action of 

Zl^^ := {{x\ x^) eZ^ \x' + x^e 2Z} . (4.1) 

Actually, for x e Z^^^ := \ ^Ln, 

v^{Mi) = M2, v,{M2) = Mi, v,{L+) = L_, v,{L^) = L+, (4.2) 

where {v^} is the natural action of Z^ on F. This shows that Z^^^j^ is the most 
complete symmetry for the problem. 

The above considerations suggest that F is better viewed as a three-dimensional 
object in which the two Manhattan lattices lie one on top of the other, with opposite 
orientations, as in Fig. |3] 



One notices that, removing B and F from F or, equivalently, setting uj^id, ±d) = 
Vx, d, splits X A into two parts that are never connected by an orbit of the RW. 
These are the Left-Right environments mentioned at the end of Section IHl 

If furthermore uJx{d,±d-^) = 1/2 Vx, li (making the environment homogeneous), 
the walk on either component is isomorphic to a standard walk in the Manhattan 
lattice (see Appendix). Thus the whole system, which we call 'symmetric Left-Right 
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Figure 3: A larger portion of F. The two embedded Manhattan lattices 
Ml, M2 are colored blue and red, respectively. Edges that lead from Mi 
to M2 (that is, from blue to red), denoted in the text, are colored 
in magenta; edges that lead from M2 to Mi (red to blue), denoted L_, 
are colored in brown. 

RW, is recurrent. This is a well-known fact and can be proved in several different 
ways (cf. also |Lej). 

One can construct ad hoc inhomogeneous PRWs whose recurrence properties are 
quickly obtained from these elementary results. 

4.1 Inhomogeneous Forward probability 

Let {Ca:}sgz2 be a collection of numbers from [0, 1]. For x G l^l^^n define, 

(ifc? = N) ij,{d,F) = („ u;,(d,L) =^,(c/,R) = (1-0/2, u;,(rf,B) = 0; 
(ifc^^N) uj,{d,F) = 0, u,{d,L)=uj,{d,K) = l/2, u,{d,B) = 0. 

(4.3) 

(Once again, the dependence of R, F, L, B on d, as per ()2.2|1 . has been omitted.) 
Similarly, for x E ^odd; 

(ifd = S) c^,(d,F) = Cx, w,(rf,L) = cu,(d,R) = (l-Cx)/2, uj,{d,B) = 0; 
(ifdy^S) uj,{d,F) = 0, uj,{d,L)=u,{d,R) = l/2, u;,{d,B) = 0. 

(4.4) 

In other words, this is a modification of the symmetric Left-Right walk in the fol- 
lowing sense: When the particle reaches a point of '^'^ven from the South, it has some 
probability to proceed Forward, that is, go North; when it reaches a point of Z^^^ 
from the North, it has some probability to go South. 
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Figure 4: Three-dimensional rendering of F. Here the graph is embed- 
ded in the {z^, z^, 2;^)-space and its vertices are the points of 7? x {0, 1}. 
Ml and M2 he in the planes {z^ = 0} and {z^ = 1}, respectively. Note 
that all "cubes" do not have the same structure in terms of L+ and L- 
(see blowups). Indeed this structure is (2Z)^-periodic in the displayed 
rendering (corresponding to Zg^g^-periodicity for the problem). 



Notice that these extra Forward displacements need not be statistically balanced. 
This means that, defining the local drift as 

Si^{x,d) := ""^^ u!x{d,d') d', (4.5) 
d'eA 

its Z^-average 

may be different from zero. (Here A is, e.g., a square whose side length is going to 
+00, and |A| is the cardinality of A). Nonetheless, one can prove the following 

Proposition 4.1 //, for at least one x G '^l^cw Cx > and, for at least one y G 
^odd' Cy > 0' PRW in the environment defined above is recurrent for all initial 
conditions. 
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Proof. In this proof and for the remainder of the section we use the 3D rendering 
of r shown in Fig. HJ Namely, we think of F as embedded in and having its 
vertices in the points of x {0, 1}. Thus, for example, Mj {i = 1,2) is embedded 
in X {i — 1}, is the set of all edges that "point upwards", B is the set of all 
vertical edges, and so on. Notice also that the action of Vx, as introduced in ()4.2p . 
corresponds to a translation by the vector (x^ + x^, —x^ + x^, 0), where {x^,x^) = x. 

Studying assumptions ()4.3|) - ()4.4|) with an eye on Fig.|l[ we see that the only non- 
horizontal edges that count (i.e., that can be traveled on with positive probability) 
are those parallel to the vector (1, 1, 1). We call them effective edges of U L_. 
All others are as good as removed. 

Denoting by {z^,z'^,z^) the coordinate system in M^, define the function ijj : 
Z2 X {0, 1} — > 1? as 

i){z^, z^, z"") ■= {z^ - z\ z^ - z^). (4.7) 

If {Zn}nm is a realization of our RW in F, with Zq = (0,0,0), set F„ := ip{Zn)- 
Geometrically this operation amounts to shifting M2 by the vector (—1, —1, 0) (thus 
aligning the orientations of M2 and Mi) and projecting the walk vertically onto Mi. 
See Fig. El 




Figure 5: Illustration of the proof of Proposition 14.11 



It is clear that {Yn} can only have same-site or nearest-neighbor jumps, the 
former case happening when, and only when, Zn shifts level. Define no := and, 
recursively, 

rim ■= min {k > n^-i \ ^ Yfc+i} . (4.8) 

Then set Y^ := This reparametrization has the effect of deleting those times 
when the F-walker does not move. Manifestly, {Y^} is the standard RW in the 
Manhattan lattice (at each site, the two outgoing edges are equivalent, in terms of 
probability) . 

By the result in the Appendix, {Y^} is recurrent. Therefore, for infinitely many 
n > 0, Yn = (0,0), that is, either Z„ = (0,0,0) or Zn — (1, 1, 1). If the second 
possibility happened all the time, this would be equivalent to infinitely many failed 
attempts at traveling from (1, 1, 1) to (0,0,0). Since, by the Markov property and 
the hypothesis, these attempts are i.i.d. with positive probability, this situation can 
only occur with probability zero. Q.E.D. 
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It is clear from the previous proof that one can conjure up an apparently similar 
environment with substantially different recurrence properties. If {(x} C [0, 1] as 
above, define, for x G '^1^^^, 

(ift/ = N,S) Uxid,F)=C., cu,(t/,L)=cu,(rf,R) = (l-C.)/2, uJx{d,B) = 0; 
{iid = W,E) Ux{d,F) = 0, Ux{d,L) = Ux{d,R) = 1/2, w^(rf,B) = 0. 

(4.9) 

Also, for X E '^Idd^ 

{We A) uJx{d,F) = 0, Ux{d,L) =Ux{d,R) = 1/2, uJx{d,B)=0. (4.10) 

Notice that in this case the space average (|4.6|) of the local drift is zero. Yet the 
following is true: 

Proposition 4.2 Suppose that > for at least one x G ^even- Then the re- 
currence of the above-defined random walk is determined by its initial condition 
^ = {xo,do). Namely, if 

xo G Zl^^^, do = E,W or Xq G Z^^^, c/q = N, S 

the walk is recurrent; otherwise it is n on- recurrent. In either case the walk has zero 
asymptotic velocity. 

Proof. Assumptions (j4.9|) - (|4.1(Jj) imply that all the effective non-horizontal edges 
belong to L+ (cf. Fig. 0]). Therefore, if the walk lands in M2, it cannot go back to 
Ml. Furthermore, by hypothesis, all walks eventually land in M2 (because — see the 
Appendix — the standard RW in Mi goes everywhere a.s., and thus will keep visiting 
sites X with Cx > until it finally rises to M2). 

The proof is now immediate, as the assertion of Proposition 14.21 reads: If the 
initial condition is in M2, the RW is recurrent; if it is in Mi, the walk is not recurrent. 
The null asymptotic velocity is a consequence of the properties of the stardard RW 
in M2. Q.E.D. 

4.2 Inhomogeneous Backward probability 

The examples presented above are not exceptional, and what can be done with an 
inhomogeneous Forward probability can be done with an inhomogeneous Backward 
probability as well. 

For instance, take once again a collection {(x} of numbers from [0, 1]. For x G 

^even, Set 

(ifrf = N) Ux{d,F) = 0, uJx{d,L)=uJx{d,R) = {l-Q/2, cu,(rf, B) = 
(ifrf^N) Ux{d,F) = 0, u;x{d,L) =iJx{d,R) = 1/2, w,.(rf,B) = 0. 

(4.11) 
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For X G Z^^j, set 

(ifc/ = S) cu,(c/,F) = 0, ^,(rf,L)=a;,(d,R) = (l-Cx)/2, u;.(c?, B) = C^; 
(ifc/^S) cu,.(c/,F) = 0, cu,.(c?,L) =cj,(d,R) = 1/2, u;,{d,B)=0. 

(4.12) 

As for the model of Proposition 14. H the local drift need not be statistically balanced. 

Proposition 4.3 Suppose that, for at least one x G Z^^gj^, Cx > and, for at 
least one y G '^l^d' Cy > 0. Suppose also that there is no x E l^lven ^^^^ ^^'^^ 
Cx = (x+s = 1- Then the PRW in the environment defined above is recurrent for all 
initial conditions. 

Proof. As anticipated, in this proof too we regard P as embedded in M.^, with 
coordinates {z^,z^,z^). 

By assumption, in this case, the effective edges of U L_ are those connecting 
(z^ z^, 0) to (zS z^, 1) or viceversa, with z^) G (2Z)2. Define ^jj : x {0, 1} — > 
1? as 

z^, z^) := {z^ + 2^ 2^ + z^). (4.13) 

In analogy with (j4.7|) . induces on P a translation of M2 by the vector (1,1,0) 
(again, this aligns the orientations of M2 and Mi), followed by a vertical projection 
onto Ml. See Fig. El 




Figure 6: Illustration of the proof of Proposition 14.31 



The non-horizontal effective edges are projected into diagonals of those unit 
squares of H? whose lower left corner belongs to (2Z)^. (These squares correspond, 
in the original problem, to the sites of Z^^^j^; compare Figs. ElandE)). These are the 
squares that, in the proof given in the Appendix, are each collapsed to a single point 
(see Fig.lH). 

This suggests the final step of our proof. For {Z„} a realization of our RW and 
as in ()A.2|) . set Yn '■= (v? o 'V^)(-^n)- It is clear that {Yn} has many "dead times", i.e., 
times n at which Y^ = Yn+i- The second hypothesis of Proposition l4.31 excluding the 
possibility that the Z- walker remains trapped in a pair of twin edges of B, implies 
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that all sequences of consecutive dead times are finite with probability 1. Hence we 
can eliminate them, as in the proof of Proposition 14.11 by introducing := Yn^, 
where the reparametrization is the same as (|4.8|) . 

It is very easy to check that {Y^} is the standard RW in 2D. Its recurrence yields 
the recurrence of {Zn} by the same argument as in the the proof of Proposition 14.11 
Q.E.D. 

It is trivial, at this point, to construct an environment with inhomogeneous, sta- 
tistically balanced. Backward probabilities, for which the conclusions of Proposition 
14.21 hold. We will not bore the reader with that. 



4.3 Random Left-Right environment 

In all the previous examples we have assumed that, at each site, the probability for 
the walker to go Left or Right was the same. We needed this symmetry to somehow 
project the given RW into a standard RW in the Mahnattan lattice, or similar. With 
the next and last example, we go beyond this assumption and show that the same 
techniques can be pushed further, with the help of some results from the theory of 
ordinary RWRE in Z^. 

For < e < 1/2 and x ranging in Zg^g^, let {(x, O be i.i.d. random vectors from 
[e, 1 — e]"^, w.r.t. to a probability distribution whose details are of no relevance. To 
each realization of {(x, C) associate an environment u & S a.s follows. For x G '^l^en^ 

(VrfGA) uJx{d,L) = uJx{d,R) = 1/2 (4.14) 

and 



oj,+e(E, N) = c^,+w(W, S) = Cx, c^x+e(E, S) = c^..+w(W, N) = 1 - C.; 
cu,.+n(N,E) =u;,.+s(S,W) =C, cu,.+n(N,W) =a;,.+s(S,E) = 1 - C- 



(4.15) 



Finally, for all a; G and d e A, 

ujx{d,d) =Ux{d,-d) =0. (4.16) 
The resulting RE is thus of the Left-Right type and is denoted, as usual, by {S, S, 11). 



Proposition 4.4 The PRWRE defined above verifies the CLT and is recurrent. 

Proof. As discussed earlier, in a Left-Right environment the edges of L+ U L_ are 
not effective and the walk ranges entirely within Mi or M2, depending on the initial 
condition. Upon closer inspection of (j4.15|) . we realize that the transition probabili- 
ties for the edges of Mi are determined solely by {Cx}, whereas the probabilities for 
the edges of M2 are governed by {Cx}- 

Without loss of generality, assume that the initial condition is Zq = (0,0,0), 
which lies in Mi. This corresponds, in the original picture, to {xq, do) = (0, N) = ^. 
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We use the same technique as in the Appendix to map our PRWRE {Zn} into a 
known RWRE in Z^. For 













( 


_ 2 




_ 2 


) 



(4.17) 



set Yn := ip{Z2n)- Let us derive the transition probabihties that the laws of {Zn} 
induce on {Yn}. Call y the element of 1? associated to {x,d) G '^l^^n ^ ^} 
the correspondence (x, d) ^ z ^ y. With the visual aid of Figs. [7| and El we verify 
that 



P'^{^n+l 
P'^{Yn+l 
Pi{^n+1 



y + E\Yn = y} = uj^id, E) cu,+e(E, N) = 
y + N\Yn = y} = ujM W) a;,+w(W, N) 
y + W I r„ = = cu,.(rf, W) cu,.+w(W, S) 
y + S I F„ = = cu^(rf, E) cj^+e(E, S) = 



Cx/2; 
= Cx/2; 

;i-a)/2. 



(4.18) 



(We restrict our attention to (x, d) G Z^^^jj^ x {N, S} because, with the chosen initial 
condition, (Xa ^, A« ) e x {N, S} Vn > 0.) 

Equations ()4.18|1 show that the environment for the F-walk is balanced, in the 
sense of Lawler, and elliptic. It is known that, Il-a.s., this ordinary RW in 7? 
satisfies the CLT and is recurrent |Lat IZj . As for for the original walk, the CLT 
holds because the time-reparametrization between {Yn} and {Zn}, or {(X„,D„)}, 
is simply linear; and the recurrence is given by the same argument used in the last 
few proofs. Q.E.D. 



A Appendix: The Manhattan lattice 

The (two-dimensional) Manhattan lattice is defined as the oriented graph M whose 
vertex set is and whose edge set is 

Em := {[{x\x'^) , {x^ + e{x'^),x^)] \{x\x'^) eZ^} U 

{ [ {x\x^) , {x\ x^ + e{x')) ] I {x\x^) G Z^} , (A.l) 

where e(j) = 1 or —1, depending on j G Z being even or odd, respectively. See 
Fig. El 

The standard random walk in M is the one for which, at each node x G Z^, the 
random walker has probability 1/2 of following either outgoing edge based in x. We 
present a proof by Guillotin jHj that this RW has the same statistical features as 
the standard RW in 2D — in particular it satisfies the CLT and is recurrent. For 

X = (x"^,x^) G Z^, define 





x^ 








( 


Y 


5 




) 



(A.2) 
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Figure 7: The Manhattan lattice M. If the four vertices of each yehow 
square are identified and time is accelerated by a factor 2, the standard 
random walk in M becomes the standard random walk in 7?. 

where [j] is the largest integer less than or equal to j G Z. If {Xn}n£N is a realization 
of the RW in M, define Yn := ip{X2n)- Denote by $ the transformation 
{Yn}, whose geometric meaning is explained in the caption of Fig. [3 

Fixing Xq = (0, 0) makes $ invertible, and a little thought convinces one that 
the endomorphism of probability spaces that $ induces between the two RWs in 
is actually an automorphism. At any rate, it is evident that {Yn} is the stardard 
nearest-neighbor RW in Z^, which immediately implies the CLT for 

As for the recurrence, one has that, a.s., Yn = (0,0) for infinitely many n. For 
those n, either X2n = (0,0) or X2n = (1,1) {tertium non datur, as 2n is even). 
By the Markov property, the latter cannot happen all the time, because there is a 
positive probability of going from (1, 1) to (0, 0). 
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